Using Fictitious Play to Find Pseudo-optimal Solutions for Full-scale Poker
نویسنده
چکیده
A pseudo-optimal solution to the poker variant, Two-Player Limit Texas Hold’em was developed and tested against existing world-class poker algorithms. Techniques used in creating the pseudo-optimal solution were able to simplify the problem from complexity from O(10^18) to O(10^7). To achieve this reduction, bucketing/grouping techniques were employed, as were methods replacing the chance nodes in the game tree; reducing it from a tree with millions of billions of terminal nodes, to a game tree with only a few thousand. When played in competition against several world-class algorithms, our algorithm displayed strong results, gaining and maintaining leads against each of the opponents it faced. Using proper abstraction techniques it is shown that we are able to succeed in approaching Nash Equilibria in complex game theoretical problems such as full-scale poker.
منابع مشابه
Deep Reinforcement Learning from Self-Play in Imperfect-Information Games
Many real-world applications can be described as large-scale games of imperfect information. To deal with these challenging domains, prior work has focused on computing Nash equilibria in a handcrafted abstraction of the domain. In this paper we introduce the first scalable endto-end approach to learning approximate Nash equilibria without any prior knowledge. Our method combines fictitious sel...
متن کاملFictitious Self-Play in Extensive-Form Games
Fictitious play is a popular game-theoretic model of learning in games. However, it has received little attention in practical applications to large problems. This paper introduces two variants of fictitious play that are implemented in behavioural strategies of an extensive-form game. The first variant is a full-width process that is realization equivalent to its normal-form counterpart and th...
متن کاملApproximating Game-Theoretic Optimal Strategies for Full-scale Poker
The computation of the first complete approximations of game-theoretic optimal strategies for fullscale poker is addressed. Several abstraction techniques are combined to represent the game of 2player Texas Hold’em, having size , using closely related models each having size . Despite the reduction in size by a factor of 100 billion, the resulting models retain the key properties and structure ...
متن کاملA full ranking method using integrated DEA models and its application to modify GA for finding Pareto optimal solution of MOP problem
This paper uses integrated Data Envelopment Analysis (DEA) models to rank all extreme and non-extreme efficient Decision Making Units (DMUs) and then applies integrated DEA ranking method as a criterion to modify Genetic Algorithm (GA) for finding Pareto optimal solutions of a Multi Objective Programming (MOP) problem. The researchers have used ranking method as a shortcut way to modify GA to d...
متن کاملOptimal Rhode Island Hold'em Poker
Rhode Island Hold’em is a poker card game that has been proposed as a testbed for AI research. This game, with a tree size larger than 3.1 billion nodes, features many characteristics present in full-scale poker (e.g., Texas Hold’em). Our research advances in equilibrium computation have enabled us to solve for the optimal (equilibrium) strategies for this game. Some features of the equilibrium...
متن کامل